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APPARATUS AND METHOD OF CORRECTING FOR DARK CURRENT 
IN A SOLID STATE IMAGE SENSOR 

FIELD OF THE INVENTION 
5 The present invention relates to solid state image sensors, and more 

particularly to methods and apparatus for correcting for dark current in a solid 
state image sensors. 

BACKGROUND OF THE INVENTION 

1 0 The photo-sites in solid state image sensors generate current in the 

absence of light due the thermal action of electrons in the devices. This thermally 
generated current is called dark current, and adds to the photo-current generated 
by the photo-sites when exposed to light. One approach to reducing dark current 
is to cool the image sensor, for example using liquid nitrogen. This approach is 

1 5 not considered practical for consumer applications. Accordingly, it is generally 
necessary to correct digital images by removing the component of the image 
signal due to dark current. To remove the dark current from the image signal, the 
level of dark current produced by the sensor must be known. If the dark current is 
under-estimated, the dark current corrected image will appear to have flare and 

20 when it is over-estimated shadows will turn black thereby causing shadow detail 
to be lost. In either case, after white balancing, it is impossible to maintain a 
neural gray without hue throughout the gray scale when the dark current is 
improperly determined. White balancing is an adjustment to the color balance of 
an image to take into account the color of the illuminant under which the image 

25 was acquired. 

One technique for determining the dark current is to measure a 
sample of image sensors in the factory to determine the average dark current 
produced by the sensors, and to employ this value for correction. This will not 
provide a satisfactory solution in cases where the dark current is temperature 
30 dependent or where it changes over time. Another technique for detemiining the 
dark current in an image sensor is to mask some of the photo-sites in the image 
sensor, sense the signal produced by the masked photo-sites and subtract the 
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sensed signal from the signals produced by the unmasked photo-sites in the image 
sensor. See for example US Patent No. 5,105,276 issued April 14, 1992 to 
Schrock. 

One problem encountered with this latter approach is that 
5 anomalies caused by the device physics may prevent a light shielded pixel from 
accurately estimating the dark current. Further, other device properties may 
change the dark current dependent upon the scene brightness or the length of the 
exposure. For example, in some CMOS image sensors the nonlinear signal 
response of the photo-sensor at low signal levels makes it difficult to estimate the 

1 0 dark current signal level from the signals produced by shielded pixels. 

It is also known to determine correction values for individual 
images by using the histograms of the images. In these applications, it is assumed 
a small predetermined percentage of the pixels are black. The next step is to form 
a histogram of the pixel values and determine the code value that is associated 

1 5 with the predetermined percentage. For example, suppose it is assumed that 2% 
of all pixels are black and the image being corrected contains 1 Megapixels. This 
means that 20k pixels in the image are assumed black. Next, all of the pixels in 
the histogram are added up starting from code value 0 to n to find the last bin for 
which the sum is less than 20k. The correction offset is then set to n. The Kodak 

20 Palm Pix camera uses this method to determine a dark level correction for a still 
image prior to any dark correction. 

This approach is not applicable to correct for dark current in a 
video stream because it would not be stable over time because the value of the 
offset is determined by an estimate that includes a range of variability. 

25 Furthermore, if previously corrected signals are used to determine the offset, the 
approach would not converge on a reasonable correction because each new 
application of correction would add to the last, driving the correction to an 
extreme. This is important since the design of available image sensors often 
include a dark level correction that is applied on the image sensor chip before the 

30 signal becomes available for the further processing that is required for 
determining the offset using the histogram method. 
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There is a need therefore for an improved technique for correcting 
for dark ciurent in a solid state image sensor that avoids the problems noted 
above. 



5 SUMMARY OF THE INVENTION 

The need is met according to the present invention by providing an 
apparatus and method of correcting for dark current in a solid state image sensor, 
that includes capturing an image with the image sensor to produce a digital image 
having pixel values; correcting the pixel values with a dark level correction value; 
10 employing a control system to adjust the dark level correction value to drive the 
number of pixels having values lower than a predetermined value chosen to 
represent dark scene content to a predetermined range. 



ADVANTAGES 

1 5 The present invention has the advantage of providing dark level 

correction without the need for a separate dark current sensor. It also is capable of 
tracking dark level changes that may not be detectable by the use of a separate 
dark current sensor. An additional advantage of the invention is that it is also 
effective to reduce the effects of veiling glare on an image sensor, thereby 

20 improving the image quality. The method of the present invention does not use 
light shielded pixels (dark pixels) or any other external reference signal, and 
therefore avoids the problems associated with the unreliability of such reference 
signals. 



25 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing a solid state image sensor and 
dark correction apparatus according to the present invention; 

Fig. 2 is a histogram useful in describing the operation of the 
present invention, illustrating pixel values with the dark current correction level 

30 too low; 
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Fig. 3 is a histogram useful in describing the operation of the 
present invention, illustrating pixel values with the dark current correction level 
too high; and 

Fig. 4 is a histogram useful in describing the operation of tiie 
5 present invention, illustrating pixel values after dark current correction according 
to the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

The present invention is based on the assumption that a small 

10 predetermined percentage of pixels in any scene have no light incident upon them 
(i.e. these pixels are dark). The pixel value associated with these pixels can then 
be assumed to be the dark level offset. The dark level correction value is adjusted 
in a feedback control loop to maintain the number of pixels that have a pixel value 
less than a predetermined value to a predetermined range. 

1 5 The assumption that a predetermined percentage of pixels will have 

no light incident on them may be invalid for some scenes, for example for a 
properly exposed low contrast scene, where there will be fewer dark pixels than 
the predetermined percentage, the method will overcorrect the dark current 
correction value. Alternatively, for a scene containing a large black object there 

20 will be more dark pixels, the method will under-correct. These situations are 
addressed by imposing limits on the dark current correction value as will be 
described below. 

Referring to Fig. 1 , an image sensor 1 0 (CCD or Active CMOS 
Imager) includes an array of photo-sites 12 that generate voltage signals that are 

25 proportional to the incident light on the photo-sites and that include a dark current 
component. The voltage signals are converted to digital values by analog to 
digital (A/D) converter 14 to produce a digital image signal. The digital signal 
from a photo-site is called a pixel, and the digital signal value is called a pixel 
value. Dark current contributes to the pixel values. 

30 To improve the appearance of the image, the digital image signal is 

corrected for dark current by subtracting 16 a dark level correction value from 
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each pixel value. The same dark level correction value is subtracted from every 
pixel. According to the present invention, a control system 1 8 is used to adjust the 
dark level correction value to drive the number of pixels having values lower than 
a predetermined value chosen to represent dark scene content to a predetermined 
5 range. The control system 18 samples 20 a dark corrected image frame from the 
dark level corrected image signal and counts 22 the number of pixel values in the 
sampled image frame that are less than a predetermined value X to produce a 
Count. 

Next, a dark level correction value adjustment is calculated 24. 

10 The dark level correction value adjustment is calculated based on the count as 
follows. If the Count is less than a number representing a first predetermined 
percentage (e.g. .03%) of the pixels in the image, the dark level correction value 
adjustment is positive (e.g. +1). If the Count is greater than a second 
predetermined percentage (e.g. 1 .0%), the dark level correction value adjustment 

1 5 is negative (e.g. -1). If the Count is between the first and second predetermined 
percentages, the dark level correction value adjustment is zero. 

The dark level correction adjustment is then applied 26 to the 
previous dark level correction value to produce a new dark level correction value. 
An initial dark level correction value can be provided. The initial correction value 

20 can be determined for example from a factory calibration, or assumed from 

experience. An initial value of 10 for example has been found to work reasonably 
well for a 10 bit digital image signal. Alternatively, the control system 18 may 
simply be allowed to stabilize over time, without initialization, which will occur in 
a relatively short time at reasonable sampling rates (e.g. 3 times per second) since 

25 the dark level correction value can normally range between 5 and 40 for a 10 bit 
digital image signal. 

To account for the cases noted above when the assumption about 
the percentage of dark pixels in an image fails, upper and lower limits are then 
applied 28 to the dark current correction value. The limits can be set around the 

30 factory calibration value for the dark level correction, typical values being 5 and 
40 for the lower and upper limits respectively for a 1 0 bit digital image signal. 
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with the factory calibration value being 1 0. Finally, the new dark level correction 
value is applied 16 to the succeeding digital image signal. 

The method of the present invention can be implemented in a video 
camera as part of an auto exposure/auto-white balance control loop to periodically 
5 adjust the dark level correction value at the same rate that the exposure and white- 
balance is adjusted. Auto exposure is generally performed on a sample of the 
digital image frames. The sampled frames are further sub-sampled to reduce the 
data rate. For example, the auto exposure control loop may be operated at 3 times 
per second (every 10**" frame in a 30 frame per second video stream), and the 

10 frames further sub-sampled to one eighth of the original size of the frame. 

In a preferred embodiment of the invention, the step 22 of 
determining the niunber of pixels having a value less than X is performed by 
forming a histogram of the pixel values in the sub-sampled frame, and summing 
the bins in the histogram from zero to the predetermined value X. 

1 5 Fig. 2 shows the histogram of an image having an under-corrected 

dark level. The image contains no pixels with a value of less than 5. Fig. 3 shows 
the histogram of an image having a properly corrected dark level. It contains an 
expected percentage of pixels with a value of less than 5. Fig. 4 shows the 
histogram of an image having an over-corrected dark level. It contains a larger 

20 than desired percentage of pixels with a value less than 5. 

The present invention can be implemented as software in a micro 
processor, as firmware in a programmed logic chip, or as hardware in a digital 
image processing circuit. Appendix A includes example C code for computing a 
simple histogram from a digital image, and appendix B includes example C code 

25 for computing the dark level correction value according to one embodiment of the 
present invention. 

The invention has been described in detail with particular reference 
to certain preferred embodiments thereof, but it will be understood that variations 
and modifications can be effected within the spirit and scope of the invention. 
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APPENDIX A 
C source code that computes a simple histogram; 

#define MAX_DARK_PIXELS 7 65 

int countDarkPixels ( ) 
{ 

ulong pixelCount - height*width; 
ushort darkPixels = 0; 

for (int i= 0; i < pixelCount; i +) 
{ 

if ( * (imageStart+i) <= 5 ) 
darkPixels++; 

if (darkPixels >= MAX_DARK_PIXELS ) 
return darkPixels; 

} 

return darkPixels; 
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C source code that analyses and adjusts the dark offset 

#define MIN_DARK_PIXELS 64 

void AdjustDarkLevel (short darkPixels) 
{ 

uint regval; 

if (darkPixels < MIN_DARK_PIXELS) 
{ 

DarkOf fset--; 

if (m_ DarkOf fset < ( DarkOf fsetCalib - 12) 
DarkOffset = { DarkOf fsetCalib - 12) 

setDarkLevel (DarkOffset) ; 

} 

else if (darkPixels >= MAX_DARK_PIXELS) 
{ 

DarkOffset ++; 

if (DarkOffset > (DarkOf fsetCalib + 2)) 
DarkOffset = DarkOf fsetCalib + 2; 

setDarkLevel (DarkOffset) ; 



